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ABSTRACT 

This booklet presents the Reading Framework for the 
1992 and 1994 National Assessment of Educational Progress (NAEP), 
which contains the rationale for the aspects of reading assessed and 
the criteria for the development of the assessment. The booklet notes 
that the new reading assessment examines students 1 abilities to 
construct, extend, and examine the meaning of what they read; 
^sses&es student performance in different reading situations; and 
includes special studies to examine other aspects of reading, 
including the fluency of students and their reading habits and 
practices. Chapters of the booklet are: (1) Development of the 
1992-94 Reading Framework (with sections on steering committee 
guidelines and on considerations and principles); (2) The Design of 
the 1992-94 Reading Framework (with sections on a goal for reading 
literacy education; constructing, extending, and examining meaning; 
and constructing the assessment); and (3) Special Studies and 
Background Information (with sections on special studies of oral 
reading and response; portfolio and metacogni t ion study; and with 
information for educational policy makers). Appendixes listing 
steering and planning committee members, and giving sample readings 
and test items for 4th, 8th, and 12th grades are attached. (RS) 
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Overview 



This document presents the Reading Framework for the 
1992 and 1994 National Assessment of Educational Pro- 
gress (NAEP), adopted by the National Assessment Gov- 
erning Board (NAGB). The Framework contains the rationale 
for the aspects of reading assessed in 1992 and 1994 and criteria 
for development of the assessment. The NAEP in Reading uses 
a variety of assessment approaches, both conventional and inno- 
vative. Developed through a national consensus process as part 
of an effort to move assessment forward, the new NAEP in Read- 
ing is more consistent with contemporary knowledge about read- 
ing and more relevant to the needs of education decisionmakers 
than earlier assessments. The new reading assessment has the 
following characteristics: 

• It examines students' abilities to construct, extend, and 
examine the meaning of what they read through the use 
of items that elicit a variety of responses to both multi- 
ple-choice and open-ended tasks. 

• It assesses student performance in different reading 
situations — reading for literary experience, reading to be 
informed, and reading to perform a task — by using 
authentic, "real-life" texts. Students in grades 8 and 12 
are permitted to choose from different short stories. 

• It includes special studies to examine other aspects of 
reading, including the reading fluency of students and 
their reading habits and practices. 



Introduction 



Reading is the most important, fundamental ability taught 
in the nation's schools. It is vital to society and to the peo- 
ple within it. It is the door to knowledge and a capability 
that can liberate people both intellectually and personally. 

For more than 20 years, the National Assessment of Educa- 
tional Progress (NAEP) has been reporting the reading achieve- 
ment of students in the United States. Known in recent years 
as "The Nation's Report Card/' NAEP reports provide descrip- 
tive information about student strengths and weaknesses in 
reading and a number of other subjects. They provide data that 
compare groups of students by race and ethnicity, gender, type 
of community, and region, as well as data that chart trends in 
achievement over time. Relationships between student achieve- 
ment and school-related experiences such as homework and in- 
struction, are also reported. 

Beginning in 1990, a significant change occurred in how and 
for whom NAEP results are reported. On a trial basis, the 1990 
NAEP Mathematics assessment collected information to provide 
"state report cards" that allow state-to- nation and state-to-state 
comparisons. In 1992, the NAEP Reading assessment included 
state-level reporting, on a trial basis, of fourth-grade results. 
For 1994, reading will be assessed again at the national and 
state levels. 

The decision to undertake state-by-state reporting of assess- 
ment data had its beginnings in 1984, when a majority of chief 
st ate 1 school office* s supported the development of an assess- 
ment system that would provide state-level information. In the 
following year, that group supported the expansion of NAEP as 
the most feasible vehicle for such an assessment system. In 
198G, two states, Wyoming and Georgia, contracted with NAEP 
t o conduct in-state assessments concurrently with the national 
assessment and to provide them with state-to-nation compari- 
son data. In i986 and 1987, several groups of southern states 
contracted with NAEP to conduct state-level assessments in 
mathematics. This effort was coordinated by the Southern Re- 
gional Education Board. 

During this period, the governors of various other states 
expressed a desire to obtain information from NAEP on the 
cducat ional achievement of students in their states. In 1987, a 
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national study group, chaired by Lamar Alexander, then Gover- 
nor of Tennessee, made a series of recommendations about the 
future of NAEP. One of the most significant was that the 
assessment be expanded to provide state-by-state reporting. 

In 1988, Congress passed the Hawkins-Stafford Amendments 
(P.L. 100-297) which added that new dimension to NAEP— a vol- 
untary trial state assessment in 1990 and 1992. The first such 
trial was conducted in spring of 1990, with 40 states and territo- 
ries participating in a mathematics assessment at grade eight 
In 1992 the trial continued with mathematics at grades four 
and eig U and reading at grade four. In 1994, the trial will be 
continued at the state level in reading. 

The decision to undertake state-by-state reporting is not with- 
out its critics — especially among reading educators. Some fear 
that state-by-state comparisons will be used to draw inappropri- 
ate inferences or to make unsupported cause-and-effect relation- 
ships. Others are concerned that the assessment design will not 
reflect appropriate educational goals. Still others fear that the 
various NAEP assessments will foster, and ultimately outline, a 
national curriculum. Reading educators, in particular, were ap- 
prehensive that the reading assessment would be insensitive to 
many theoretical and instructional developments in the field, 
and that it might oversimplify the complex set of behaviors that 
are integral to reading. 

The first report card related to America's national education 
goals was released in the fall of 1991. But it contained many 
gaps, especially at the state level. Reading information was lim- 
ited to what could be inferred from SAT scores. There is clearly 
a need for an assessment that will allow states to determine the 
success with which they have met the goals established by the 
President and the nation's governors. The 1992-94 NAEP in 
Reading fills a critical gap in this area. 



Chapter One 



Development of the 1992-94 
Reading Framework 

The Reading Framework for the 1992-94 National Assess- 
ment of Educational Progress (NAEP) contains the ration- 
ale for the aspects of reading to be assessed and criteria 
for development of the assessment. The national consensus proc- 
ess used to develop this Framework was guided by the following: 

• A general pattern of consensus development, which was 
set forth by law and which has evolved over time, that 
calls for "active participation of teachers, curriculum spe- 
cialists, subject matter specialists, local school adminis- 
trators, parents, and members of the general public" 
(Public Law 100-297, Part C, 1988). 

• The decision that the reading assessment would pilot 
state-by -st ate comparisons, which increased the impor- 
tance of the consensus process. 

• Recognition that experts, educators, and interest groups 
in reading often hold diverse and conflicting views that 
have not been completely clarified, much less settled, by 
research in the field. 

The process of developing the Framework was carried out in 
late 1989 and early 1990 under the direction of the National As- 
sessment Governing Board (NAGB). Created by Congress under 
P.L. 100-297, NAGB is responsible for formulating policy for 
NAEP. The Board is specifically charged with selecting subject 
areas to be assessed, developing assessment objectives and test 
specifications by use of a national consensus approach, identify- 
ing appropriate achievement goals for ea "i age and grade, and 
other NAEP policy responsibilities. 

To prepare the new Reading Framework, NAGB awardpd a 
contract to the Council of Chief State School Officers (CCSSO). 
The consensus process involved a Steering Committee, a Plan- 
ning Committee, and the project staff at the Council of Chief 
State School Officers. The following describes the composition 
of each of these groups and outlines the roles each played. 



• The Steering Committee consisted of members repre- 
senting 16 national organizations (see appendix A). 
This group met initially in October 1989 to provide guid- 
ance for the consensus process and two additional times 
to respond to the progress of the work on the Framework 
and to offer additional guidance. Drafts of each version 
of the developing Framework were sent to members of 
this committee for review and reaction, 

• The Planning Committee of 15 members consisted of ex- 
perts in reading, including several university professors, 
the dean of a college uf education, a classroom teacher, a 
school administrator, state-level specialists in reading 
and assessment, and a representative of the business 
community (see appendix A). This committee was estab- 
lished to identify the goals for the assessment and to 
prepare the Framework, It met with the Steering Com- 
mittee early in the project and three subsequent times 
as it developed the plan for the new Reading Assess- 
ment. A subgroup of this committee met in January 
1990 to develop the specifications for the assessment. 

• The project staff at the Council of Chief State School Of- 
ficers included a director, a project coordinator, and a 
project associate (see appendix A J, In addition to meet- 
ing with the Steering Committee and the Planning Com- 
mittee, this group maintained regular contact with staff 
and members of the National Assessment ( loverning 
Board. 

As the Framework was being developed, the project staff con- 
tinually sought guidance and reaction from a wide range of peo- 
ple in the fields of reading and assessment, from school teachers 
and administrators, and from state coordinators of reading and 
reading assessment. After thorough discussion and some 
amendment, the recommended Framework \vns adopted by the 
Governing Board in March 15MMI. 




Steering Committee Guidelines 

At its first meeting, the Steering Committee established 
guidelines to be followed in developing the framework: 

1. Focus on outcomes or be performance oriented, rather 
than reflect a specific instructional or theoretical ap- 
proach. The Framework should not focus on the specific 
reading skills that lead to outcomes but on the outcomes 
themselves. 

2. Address the increasing literacy needed for employability, 
personal development, and citizenship. 

3. Expand the range of assessment tools to include such 
techniques as open-ended questions and other new ap- 
proaches and formats appropriate to the objectives. 

4. Account for contemporary research on reading and liter- 
acy but not imply a departure from the primary focus on 
outcomes. 

5. Provide information to policymakers and educators that 
will assist them in making decisions about the improve- 
ment of educational performance. 

6. Include general statements about what is reasonable 
reading performance for 4th, 8th, and 12th graders. 

Considerations and Principles 

The development of this Framework for the National Assess- 
ment of Educational Progress in Reading was guided by 
several considerations and principles — some resulting from the 
nature and purpose of the assessment, others reflecting the 
thinking and values of the Planning Committee and the Steer- 
ing Committee. 

The Nature of Assessment 

The NAEP in Reading is an assessment conducted on a repre- 
sentative sample basis, not a test of individual performance. It 
is designed to inform policymakers and the public about achieve- 
ment in the United States in broad terms. Thus, it is not de- 
signed to diagnose the causes of problems in individual 
students, schools, or districts. Furthermore, although analysis 



of NAEP data can direct and inform research, the assessment is 
not designed primarily as a research instrument 

NAEP data in reading can be used to inform participating 
states of some of the strengths and weaknesses of their stu- 
dents' performance. The data can ar :) be used to inform individ- 
ual states and the country as a whole of some of the links among 
reading-related activities in schools, student and teacher back- 
ground characteristics, and performance in certain aspects of 
reading. 

Reading Literacy 

The term "reading literacy' 1 is not intended to imply only ba- 
sic or functional literacy. Rather the term connotes a broader 
sense of reading, including knowing when to read, how to read, 
and how to reflect on what has been read. Contemporary re- 
, search indicates that reading is a complex process that involves 
an interaction among the reader, the text, and the context in 
which something is read. Because reading is not considered to 
be a simple, unidimensional skill, reading achievement cannot 
be represented adequately by a single score. Whereas some as- 
pects of reading, such as how well a reader summarizes a pas- 
sage, can be measured directly; other aspects, such as how a 
reader utilizes reading strategies, can be measured only 
indirectly. 

Assessment and Instruction 

Assessment by itself should not drive instruction. Educators, 
in response to societal expectations, should set goals or stand^ 
ards that assessments can measure and serve. However, teach- 
ers often do use assessment tasks to set priorities for what they 
teach. With this in mind, the Planning Committee determined 
that the NAEP in Reading must contain passages and tasks so 
similar to those which students encounter in classrooms and in 
their own reading that, should teachers choose to do so, they 
could use the kinds of passages and tasks found on the assess- 
ment to set priorities in their classrooms without distorting 
instruction. 
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New Methodologies 

A consensus of societal goals and values, the best available 
reading theory and research, and the wisdom gained from class- 
room experience — but not primarily traditional psychometric 
theory — should drive the design of the assessment. The Frame- 
work must not promote assessment items that in terms of corre- 
lating with reading ability, have only statistical utility, but do 
not correspond to sound concepts of reading or resemble desir- 
able classroom activities. Although the aspects of reading that 
can be measured in a project of notional e ope are limited 
by available resources, development time, and methodology, 
every effort must be exerted to make the best use of available 
methodology and resources. Capabilities in assessment must be 
driven forward, so that important aspects of reading that now 
elude measurement can be addressed in the near future. To- 
ward these ends, new types of items and new methods of analy- 
sis were used for the 1992-94 NAEP in Reading along with 
well-constructed multiple-choice items. 

The Basis of the Framework 

Because the 1992 and 1994 reading assessments include trial 
reporting of state-level results, concerns about the strength of 
the assessment design and about how the results will be re- 
ported have increased. Aware of these concerns, the Planning 
Committee attempted to develop a Framework that provides for 
an assessment that reflects both professional consensus and the 
best technical design possible in a large-scale reading assess- 
ment. The committee was aware that the Framework should 
represent a broad concept of reading that reflects the views of 
contemporary research, yet recognizes those aspects of reading 
currently emphasized in local school districts. It also should rec- 
ognize that a variety of approaches and programs can produce 
successful readers. Therefore, in preparing this Framework, the 
committee considered a variety of perspectives, emphases, and 
opinions among professionals in universities and in state and lo- 
cal school districts. They began their work by identifying the 
most importa.it goal of reading literacy education. 
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Chapter Two 



The Design of the 

1992-94 Reading Framework 

A Goal for Reading Literacy Education 

If the term "reading literacy" is used to describe a broad 
sense of reading, including knowing when to read, how to 
read, and how to reflect on what has been read, th -n an obvi- 
ous goal of reading literacy education is to develop — in this 
broad sense — good readers. Substantial research and classroom 
experience have provided a great deal of information about good 
readers. In general, good readers have positive attitudes about 
reading and positive self-perceptions of themselves as readers. 
They choose to read a variety of materials, recognizing that read- 
ing serves many purposes in their lives. They read often and 
have developed their own criteria for what makes a text enjoy- 
able or useful. They function successfully in schools, homes, and 
workplaces. They attain personal satisfaction that can come 
only from reading. 

Some characteristics of good readers that distinguish them 
from less proficient readers follow. Good readers 

a. Possess positive habits and attitudes about reading; 

b. Read with enough fluency so that they can focus on the 
meaning of what they read; 

c. Use what they already know to understand what they 
read; 

d. Form an understanding of what they read and extend, 
elaborate, and critically judge its meaning; 

e. Use a variety of effective strategies to aid their under- 
standing and to plan, manage, and check the progress of 
their reading; 

f. Can read a wide variety of texts and can read for differ- 
ent purposes. 

The Planning Committee proposed that these characteristics 
of good readers provide the reference points for decisions about 
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which aspects of reading would be assessed in NAEP. This ori- 
entation toward good readers reflects a focus on performance 
rather than a focus on instructional approaches in reading. In 
line with this orientation, the Planning Committee determined 
that the major focus of the new NAEP in Reading be an assess- 
ment of student performance that uses three types of reading 
situations and involves several ways that students can con- 
struct, extend, and examine the meaning of what they are read- 
ing. In addition, the assessment gathers information about 
other important aspects of how students read, including fluency, 
use of different strategies to aid understanding, and the kinds of 
reading they engage in both in and out of the classroom. The 
next sections focus on these features of the assessment. 

Types of Reading Situations 

Reading for meaning involves a dynamic, complex interaction 
among three elements: the reader, the text, and the context. 
Tlv context of a reading situation includes the purposes for 
reading that the reader might use in building a meaning of the 
text. The graphic below illustrates the reader-text-context 
interaction. _ 



context 




Good readers bring to this interaction their prior knowledge 
about the topic of the text and their purposes for reading it, as 
well as their skill in reading, which includes their knowledge 
about the reading process and about the structure of texts. Dif- 
ferent types of texts have different organizations and features 
that have on effect on how a reader reads them. Readers ore ori- 
ented to a given text very differently, depending on the text it- 
self ond on their purposes for reading. Some readers are 
comfortable and successful when reading stories but are uncom- 
fortable and unsuccessful when reading directions for assem- 
bling a bicycle. Some readers may have learned how to read 
and learn from textbooks but are less able to approach and 

16 
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appreciate a poem. Because students can be more or less profi- 
cient in reading different types of texts and in adopting different 
purposes for reading, it seems evident that the assessment of 
their performance must involve different types of text and differ- 
ent purposes for reading. 

The 1992-94 NAEP reflects these considerations by assessing 
three general types of text and reading situations: 

• Literature — reading for literary experience, 

• Information — reading to be informed, and 

• Documents — reading to perform a task. 

The following discussion examines important characteristics 
of each of these situations. 

Reading for literary experience usually involves the read- 
ing of novels, short stories, poems, plays, and essays. In these 
reading situations, readers explore the human condition and con- 
sider interplays among events, emotions, and possibilities. In 
reading for literary experience, readers are guided by what and 
how an author might write in a specific genre and by their expec- 
tations of how the text will be organized. The readers' orienta- 
tion when reading for literary experience usually involves 
looking for how the author explores or uncovers experiences and 
engaging in vicarious experiences through the text. 

Reading to be informed usually involves the reading of arti- 
cles in magazines and newspapers, chapters in textbooks, en- 
tries in encyclopedias and catalogues, and entire books on 
particular topics. The type of prose found in such texts has its 
own features. To understand it, readers need to be aware of 
those features. For example, depending upon what they are 
reading, readers need to know the rules of literary criticism, or 
historical sequences of cause and effect, or scientific taxonomies. 
In addition, readers read to be informed for different purposes; 
for example, to find specific pieces of information when prepar- 
ing n research project, or to get some general information when 
glancing through n magazine article. These purposes call for dif- 
ferent orientations to text from those in reading for literary expe- 
rience becuuso readers are specifically focused on acquiring 
information. 

Reading to perform a task usually involves the reading of 
documents such as bus or train schedules; directions for games, 
repairs, classroom, and laboratory procedures; tax or insurance 
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forms; recipes; voter registration materials; maps; referenda; 
consumer warranties; and office memo.% When they read to per- 
form tasks, readers must use their expectations of the purposes 
of the documents and the structure of documents to guide how 
they select, understand, and apply such information. The read- 
ers' orientation in these tasks involves looking for specific infor- 
mation in order to do something. Readers need to be able to 
apply the information, not simply understand it as is usually the 
case in reading to be informed. Furthermore, readers engaging 
in this type of reading are not likely to savor the style or 
thought in these texts, as they might in reading for literary 
experience. 

Scales 

The reading situations described above form the basis for the 
development of scales by which the 1992-94 NAEP in Reading 
are reported. Performance on the literary, informational, and 
task-perfovming components are reported on separate scales. 

Th<i proportion of iteus related to each of the reading situ- 
ations changes from grade to grade to reflect the changing de- 
ma nds i^ade of students as they mature. The proportions of 
i^rns at each grade level are shown below. 



Grade 


literary 


To Be 


To Perform 




Experience 


Informed 


A Task 


4 


55% 


45% 


(No Scnle) 


8 


40% 


40% 


207r 


12 


35% 


45% 


207r 



At the four Ji-grade level, reading to perform a task will not 
be reported as a scale but rather as descriptive results. This de- 
cision was the result of three considerations: ( 1) To construct a 
scale in reading to perform a task, approximately one-fifth (20 
percent) of the total items in the fourth-grade assessment would 
need to be devoted to those items. (2) Reading to perform a 
task, while important, probably does not reflect one-fifth of the 
type of independent reading fourth graders usually do. (3) By 
decreasing the number o f items for reading to perform a task, 
more assessment time can be devoted to having students re- 
spond through extended writing to op:>ii-ended questions about 
longer, authentic texts. 
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The proportions of items in the 8th- and 12th-grade assess- 
ments are meant to reflect the reading that 8th and 12th grad- 
ers are doing. Although literature is still very important for 
these students, they read extensively for information in content 
areas such as social studies and science, for information related 
to hobbies and interests, and for job-related purposes. 

These scales support the need for teachers of science, civics, 
health, business, and technology — as well as literature— to un- 
derstand the importance of skilled reading in their content areas 
and to promote the types cf reading necessary to perform well in 
their classrooms. 



Readers respond to a given text in a variety of ways as they 
use background knowledge and information from the text to con- 
struct an initial understanding, develop an interpretation to ex- 
tend the text's meaning, and examine the meaning so as to 
respond personally and critically to the text. These various in- 
teractions between readers and texts do not form a sequential hi- 
erarchy or a set of subskills. Rather, they should be in the 
repertoire of readers who are at every developmental level in 
reading. An understanding of these interactions was crucial in 
the development of the assessment. 

Forming an Initial Understanding 

Forming nit initial understanding requires readers to provide 
an initial impression or global understanding of what they have 
read. It involves considering the text as a whole or in a broad 
perspective. In the assessment, the first question following the 
passage taps this aspect of reading. Questions on initial under- 
standing might include the following: 

• Write a paragraph telling what the story/poem is about, 

• Which of the following is the best statement of the 
theme of this story? 

• Write a paragraph telling what this article generally 
' *ls you. 

• What is this supposed to help you do? 

• What would you tell someone about the main character? 



Constructing, Extending, and 
Examining Meaning 
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Developing an Interpretation 

Developing an interpretation requires readers to extend their 
initial impressions to develop a more complete understanding of 
what they have read. It involves linking information across 
parts of a text as well as focusing on specific information. Ques- 
tions that ask readers to develop their interpretation might in- 
clude the following: 

• How did the plot begin to develop? 

• What caused the character to do this? Use examples 
from the story to support your answer. 

• What caused this event? 

• What type of person is this character? Use information 
from the text to support your answer. 

• In what ways are these ideas important to the topic or 
theme? 

• What will be the result of this step in the directions? 

• What does this character think about ? 

Personal Reflection and Response 

Personal reflection and response requires readers to connect 
knowledge from the text with their own personal background 
knowledge. The focus here is on how the text relates to personal 
knowledge. Questions that ask readers to reflect and respond 
from a personal point of view might include the following: 

• How did this character change your ideas of . 

• Do you think that (a grandmother and a 5-year- 
old) would interpret this passage the same way? 
Explain. 

• How is this story like or different from your own per- 
sonal experience? Explain. 

• What current event does this remind you of? Explain. 

• Does this description fit what you know about ? 

Why? 

• What does this passage/story say to you? 
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• Why do you think (bullfrogs eat dragonflies?) Is 

there anything else you think they might eat? What 
parts of the passage, information from other books, or 
your own knowledge helped you answer this? 

Demonstrating a Critical Stance 

Demonstrating a critical stance requires readers to stand 
apart from the text and consider it objectively. It involves a 
range of tasks, including critical evaluation, comparing and 
contrasting, and understanding the impact of such features as 
irony, humor, and organization. Questions asking readers to 
demonstrate a critical stance might include the follow ing: 

• Compare this article/story to that one. 

• How useful would this be for ? Why? 

• Do you agree with the author's opinion of this event? 

• Does the author use (irony, personification, humor) effec- 
tively? Explain. 

• What could be added to improve the author's argument? 
Why? 

• Is this information needed? 

• What other information would you need to find out that 
you don't know now? 

The assessment also contains some questions that require 
readers to make connections across parts of a text or between 
texts, For example, students might be asked to compare a poem 
and « story with the same theme or to relate information from a 
first-person account to a textbook description of an event 

The following table illustrates the interactions among the as- 
pects of reading assessed in the 1992-94 NAEP, 
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The 1992-94 NAEP in Reading: 
Aspects of Reading Literacy 

Constructing, Extending, and Examining Meaning 



Initial 
Understanding 

Requires the reader 
to provide an initial 
impression or 
unreflected under- 
standing of what 
was read. 



Developing 
Interpretation 

Requires the reader to go 
beyond the initial impres- 
sion to develop a more 
complete understanding 
of what was read. 



Reading for 

Literary 
Experience 



Heading 

for 

Information 



Reading to 
Perforata 
Taik 



What is the 
story/plot about? 

How would you 
describe ths main 
character? 



What does this 
article tell you 
about ? 

What does the 
author think 
about this topic? 

What is this 
supposed to help 
you do? 

What time can you 
gat a non-atop flight 
to X? (Search) 



How did the plot 
develop? 

How did this character 
change from the begin- 
ning to the end of the 
story? 

What caused this event? 



In what waye are these 
ideaa important to 
the topic or theme? 

What will be the 
reeult of this step in the 
directione? 

What must you do 
before this step? 



Some qUMtiunM require mMktntf tinkiine* ncrtm park of a text, or between text* u*inf( either 
Demon*] reflection, cri Ileal ninnce. or both. 

Klu*ncy— Specif ntudy of how Well ntudenU read orally. 
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The 1992-94 NAEP in Reading: 
Aspects of Reading Literacy 

Constructing, Extending, and Examining Meaning 



Raadinf for 
Literary 
Experience 



Personal Reflection 
and Response 

Requires the reader to 
connect knowledge from 
the text with his/her own 
personal background 
knowledge. The focus 
here is on how the text 
relates to personal 
knowledge. 

How did this character 
change your idea 
of ? 

Is this stoiy similar to 
or different from your 
own experiences? 



Demonstrating a 
Critical Stance 

Requires the reader to 
stand apart from the text 
and consider it. 



Rewrite this stoiy with 

as a setting or 

as a character 

How does this author's 

u«eof (irony, 

personification, humor) 
contribute to ? 



Reading 

for 

Information 



Reading to 
Perform a 
Task 



What current event 
does this remind you of? 



How useful would this 

article be for 

Eiplain, 



Does this description fit What oould be added to 
what you know about improve the author's ar- 
? Why? gument? 



In order to , 

what information would 
you need to find that you 
don't know right now? 

Describe a situation 
where you could leave 
out step X* 



Why is this information 
needed? 



What would happen if 
you omitted this? 



Strategic B*h«vidtn and Knowledge about Reading— When yau hitvr difficulty undcr- 
nUnding what you *tt rending, what do ynu do? 

Rending Ifabltaartd Practice*— Havryou read a book for rnjnymrnt In the )nni werkV Da 
you have a library card for your public library? 
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Constructing the Assessment 



Designing Items 

To effectively and efficiently explore the abilities of students 
to construct, examine, and extend meaning in a text, a combina- 
tion of open-ended and multiple-choice items is used in the as- 
sessment. The type of itemu — multiple-choice or open-ended — is 
determined by the nature of the task. 

The Board supported the inclusion of many open-ended items 
for a number of reasons. The first has to do with the nature of 
reading. As they read, readers are involved in a number of proc- 
esses, including integrating information from the text with their 
own background knowledge, reorganizing ideas, and analyzing 
and critically considering the text In an assessment of reading, 
it is important to have items that can most directly and accu- 
rately reflect how readers use these processes. Open-ended 
items that require extended responses provide a means of exam- 
ining whether students can generate thnir own organized and 
carefully thought out responses to what they have read. Multi- 
ple-choice items do not permit this kind of assessment. Further- 
more, open-ended items more closely resemble the real-world 
reading tasks that students must be able to perform to be suc- 
cessful in and out of school. Finally, open-ended items are the 
trend in state and international assessment programs. It is im- 
portant that NAEP participate in such developments. 

Multiple-choice items are used where the nature of the task 
calls for a single, clear answer to a question. Multiple-choice 
questions on the 1992 and 1994 assessments emphasize critical 
thinking and reasoning rather than factual recall. 

Open-ended items are scored using primary-trait scoring, 
with scoring rubrics created for each question. Primary trait 
scoring rates how well a reader accomplishes a task according to 
a few major criteria. The rubrics guide the scoring by giving spe- 
cific criteria for assigning a number score to levels of success in 
answering the question. (See appendix B for passages and ru- 
brics.) 

To ensure that only important questions (those that will ve- 
veul how readers construct an understanding or extend and ex- 
amine the meaning of the text) are used, the assessment 
passages were analyzed, using an approach such as mapping es- 
sential text elements, before the questions were developed. The 




analysis of passages using such a method helped the test devel- 
opers to determine if a given passage has a coherent, orderly 
structure and is rich enough In meaning to provide several items 
useful for examining student performance. 

The first question following n selection taps the student's in- 
itial understanding of the passage. Questions requiring a more 
developed understanding or further examination of the meaning 
of the passage then follow. Some questions require readers to in- 
tegrate or compare information across more than one passage. 

Selecting Passages 

Passages selected for the assessment were drawn from 
authentic texts actually found and used by students in real, 
everyday reading. Whole stories, articles, or sections of text- 
books were used, rather than excerpts or abridgements. 
Passages written solely for a test or to provide drill in a specific 
skill were not considered appropriate for this assessment. 

Does the use of authentic passages give some students an un- 
fair advantage because of their familiarity with the texts? Two 
safeguards protect against this. First, passages are not drawn 
from classroom basal readers; but are taken from books and 
magazines students are unlikely to have read. For example, 
some passages might be taken from magazines published in 
1990 or earlier. The second safeguard i* the nature of the items. 
They require students to engage in careful inspection and consid- 
eration of the passages so that even in the unlikely event that a 
student has read a given passage, she or he would need to re- 
read and reconsider it to respond to the items. 

The difficulty of items is a function of the difficulty of the pas- 
sages and of the amount of background-knowledge a reader 
must use from outside the text itself to answer them. Because 
of their limitations, conventional readability estimates were not 
the only or even the main criteria for determining the difficulty 
levH of a passage. Rather, the difficulty of text was judged by 
its length, the complexity of its arguments, the abstractness of 
its concepts, unusual points of view, and shifting time frames — 
factors that are not addressed by traditional readability meas- 
ures. As the difficulty of the passages increases, so does the 
difficulty of the questions, since the questions focus on impor- 
tant points in the text, 
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Texts range in difficulty from those that specific grade-level 
teachers agree could be read by the least proficient students in a 
class (for example, about grade two in a fourth-grade class) to 
those texts that can be read by only the most proficient readers 
in the class (possibly grade-eight level in a fourth-grade class). 

In general, the assessment consists of items that most stu- 
dents at the given grade levels can do. This means not only that 
students possess the requisite abilities, but also that they are 
likely to have actually encountered the particular type of text or 
task. 




Chapter Three 



Special Studies and 
Background Information 

Special Studies 

Reading is a complex process that is being understood bet- 
ter os it is studied over time. Time constraints and the 
large numbers of students involved in the 1992-94 NAEP 
in Reading limit what is included in the assessment. The assess- 
ment does not represent completely all aspects nf the reading 
process that are supported by current reading theory and re- 
search. The Planning Committee, however, believed in the im- 
portance of addressing as many facets of reading as possible and 
in acknowledging new and promising approaches to reading as- 
sessment. For these reasons, the committees proposed conduct- 
ing special studies. These studies focus on three important 
aspects of reading: fluency, reading habits and practices, and 
nietacognition. Two of these — an oral reading and response 
study and a gathering of portfolio-like samples of classroom 
reading activities — are combined into the Integrated Reading 
Performance Record (IRPR). The third is a study of the metacog- 
nitive strategies students use to comprehend what they read. 
The IRPR was part of the 1992 assessment, using a sample of 
fourth-grade students in the National Assessment. 

Oral Reading and Response Study 

A part of the Integrated Reading Performance Record, the 
Oral Reading and Response Study addresses concerns that 
fourth graders may not have the ability to recognize or figure 
out words as they read. Because the study focuses on actual 
readini! performance, it also explores the potential of NAEP to 
be based more mi student performance. 

Tin' nnporlaiire of reading fluency goes beyond individual 
void ri'ingiillion or accurate oral reading. Heading fluency in- 
volves the ellu lent, automatic recognition of words that permits 
icadeih to all end lo understanding and thinking about what 
tin s are reading Kven the most tentative beginning readers 
t an. at main leveli,, understand some of what, they read. 
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Fluent renders, however, possess facility with written language 
that makes it possible for thern to devote sufficient attention to 
understanding the text's meaning rather than only identifying 
tho written word.*. The fluency with which readers can use all 
of the cues in a text, including syntax, semantics, and phonics, 
contributes to the effectiveness with which they understand 
what they read. In this sense, fluency is one means to some im- 
portant ends. 

In the assessment, fluency is determined by an analysis of 
students 1 oral reading of a passage from the assessment. The 
oral reading o' a passage was chosen as the vehicle for assessing 
fluency because passage reading is observable and, as opposed 
to the reading of isolated words, allows students to use strategi- 
cally their full range of text-processing skills. 

Students are asked to read orally and respond to a passage 
they have » ead silently and answered questions about as a part 
of the regular assessment. An analysis is made of their oral 
reading P uency by looking for evidence of their use of phonics, 
sight vocabulary, semantics, and language structure. The rela- 
tion of fuency to comprehension is also examined. The stu- 
dents' oral responses are related to their written responses to 
the passage. Because individual readers are asked to respond 
oralb to the same questions they responded to in writing on the 
main assessment, examination of whether responses are similar 
in both modes is possible. It permits a consideration of the de- 
gree to which performance on the open-snded written questions 
might be confounded with students 1 writing abilities. 

The purpose of this oral reading study is to pilot and refine 
the methodology and determine the usefulness of the results. A 
decision can then be made about whether to include examina- 
tion of oral fluency on future assessments and possibly to extend 
it to other grade levels. 

Portfolio Study 

Portfolio assessment has engaged the interest of practitioners 
and policymakers as a means of documenting literacy perform- 
ance in the day-to-day context of classroom life. Some portfolio 
components are included in the Integrated Reading Performance 
Record, The set of components is modest and does not represent 
a complete portfolio. However, given the high level of interest in 
this approach to literacy assessment and the potential value of 
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such an approach, it is deemed important to gather some data 
that might inform future assessment efforts. 

The two main purposes of the portfolio study are to gather 
and analyze examples of classroom work in reading and to inter- 
view students about their reading activities both in and out of 
school. Components of the study include samples of students' 
daily work such as worksheets, written summaries, flow charts, 
or answers to open-ended questions. These samples are chosen 
by teachers, with student participation, and are analyzed to indi- 
cate the types of activities teachers are actually using in class- 
rooms and how well students demonstrate in their daily work 
the types and aspects of reading examined in the assessment. 
In addition, interviews with students about their reading of self- 
selected books provide some information about student reading 
habits and practices. 
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The portfolio component study can become an important part 
of NAEP because it opens a window on the classroom. Such a 
study is valuable because it (1) provides information on stu- 
dents' self-selected reading outside of school and how their re- 
sponses to whole books compare with responses to passages on 
the actual assessment; (2) offers some information about what is 
actually happening in classrooms during reading instruction; (3) 
permits examination of the types of reading responses students 
make on a daily basis; (4) begins to involve teachers directly in 
the assessment, rather than just in the usual question-and- 
answer section of a background questionnaire; and (5) permits 
large-scale exploration of an approach to assessment that is 
gaining support in states and districts throughout the country. 

Metacognition Study 

The term nietacorniition is used to describe the knowledge 
and strategies thut good readers use to monitor their comprehen- 
sion, such as predicting, skimming, and re-reading. Research 
has shown that good readers are strategic. That is, they know 
about and select strategies and approaches to their reading, and 
they use these strategies and approaches to help them under- 
stand nnd check their success in accomplishing their purposes 
for reading. In addition, research has provided a number of in- 
sights into what good readers specifically do before, during, and 
after reading. 

Before reading, good readers consider what the text is going 
to be about, what they already know about the topic and the text 
genre, how fast or slowly they need to read, and what specifi- 
cally they are looking for as they read. While reading, good read- 
ers ask themselves many questions; Does the meaning they are 
developing make sense? What might come next? Are they using 
the right speed? Are they using the right background informa- 
tion? What might they do to understand better? After reading, 
good readers decide if they have successfully read the text, 
whether they should go back and examine specific parts of the 
text , or whether they should reread for different purposes using 
a different strategy. Throughout the reading process, good read- 
ers 1 decisions about which strategies to apply are guided by an 
understanding of the purposes and structures of different types 
of text and by a knowledge of how to construct and examine 
meaning. 
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How students use strategies for monitoring their under- 
standing and knowledge about reading is being considered in a 
separate but related 3tudy. The main purpose of the study is to 
determine efficient and reliable means of assessing students' 
awareness and use of reading strategies. The study will exam- 
ine the usefulness of different formats, such as written or oral re- 
sponses and multiple-choice or open-ended items* It also weighs 
the effectiveness of certain specific questions such as: 

• How did you read the passage above? (Fast, slowly, 
skimmed it, carefully?) Explain why. 

• What especially helped you understand this part of the 

passage? 

• What would help you answer/do this? 

• What do you think will come next? 

• Was there a place where you stopped to reread? 
Underline it in the passage. 

The study, planned for a future assessment, will provide infor- 
mation about students' awareness and use of reading strategies 
that can be reported along with the results of the inain Reading 
Assessment. 

Information for Educational 
Policymakers 

Information useful to education policymakers is obtained 
*rom student questionnaires that are part of the 1992-94 NAEP 
in Reading and from questionnaires to which teachers and prin- 
cipals respond. The data gathered from these questionnaires, as 
well as those gathered in the Portfolio Study, give additional in- 
formation about reading instruction in American schools and 
about the reading habits and practices of students. Some of this 
information focuses especially on topics that policymakers can 
address, such as access to a library at school or availability of a 
variety of reading materials in classrooms. 

In summary, the NAEP in Reading for 1992-94 represents a 
collaborative effort among educational agencies, educators, and 
those interested in education to provide relevant and valid infor- 
mation about how well American students read and about fac- 
tors affecting their performance. To thii end, the Framework 
includes the best approaches possible at this time for gathering 
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information on reading performance and activities related to 
becoming good readers. In addition, the assessment is designed 
to endorse high standards for student achievement and set forth 
realistic goals for effective reading literacy in the 21st century. 
The assessment seeks to advance both reading and its assess- 
ment, while pointing the way for continued progress in the 
future. 
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Appendix B 

Sample Items 



Grade 4 — Reading for Information 



Amanda Clement: 
The Umpire in a Skirt 

by Marilyn Kratz 

It was a hot Sunday afternoon in llawarden, a small town in 
western Iowa, 

Amanda Clement was sixteen yonm old, She sat quietly in 
the grandstand with her mother, hut she imagined herself right 
out there on the baseball diamond with the players. Hack home 
in Hudson, South Dakota, her brother flank and his friends 
often asked her to umpire nan urn, Sometimes she was even 
allowed to play first base. 

Today, Mandy, as she was called, could only sit and watch 
Hank pitch for Renville against Hawarden. The year was 1904, 
and girls were not supposed to participate in sports. But when 
the umpire for the preliminary game between two local teams 
didn't arrive, Hank asked Mandy to make the calls. 

Mrs, Clement didn't want her daughter to umpire a public 
event, but at last Hank and Mandy persuaded her to give her 
consent, Mandy eagerly took her position behind the pitcher's 
mound. Because only one umpire was used in those days, she 
had to call plays on the four bases as well as strikes and balls. 

Mandy was five feet ten inches tall and looked very impres- 
sive as she accurately called the plays. She did so well that the 
players for the big game asked her to umpire for them — with 
pay! 

Mrs, Clement was shocked at that idea, But Mandy finally 
persuaded her mother to allow her to do it Amanda Clement 
became the first paid woman baseball umpire on record. 

Mandy' s fame spread quickly. Before long, she was umpiring 
games in North and South Dakota, Iowa, Minnesota, and 
Nebraska. Flyers, sent out to announce upcoming games, called 
Mandy the "World Champion Woman Umpire," Her uniform was 
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a lung blur skirt, a Murk necktie, and a white blouse with 
LJMPS stenciled nernsB tin* front. Mandy kept her long dark 
huir tucked in Hide a (waked cap. She commanded respect and 
attention— players never said, "Kill the umpire!" They argued 
more politely, asking, "lti*f? your pardon, Miss Umpire, but 
wasn't that one a bit high?" 

Mainly is recognized in the Baseball Hall of Fame in Coopers- 
town, New York; the Women's Sports Hall of Fame; and the 
Women's Sports Foundation in San Krancitco, California. In 
1912 she held the world record for a woman throwing a baseball; 
279 feet 

Mandy's eurnings for her work as an umpire came in espe- 
cially handy. She put herself through college and became a 
teacher and coach, organizing teams and encouraging athletes 
wherever she lived. Mainly died in 1971. People who knew her 
remember her for her work as an umpire, teacher, and coach, 
and bemuse she loved helping people as much as she loved 
sports. 



"Amanda Clement: Th* Umpire in a Skirt", by Marilyn Kratz. 
Copyright f" 1UM7 by Marilyn Kratz. 
('npyrigbt 1HH7 by < !uniH Corporation. 
Reprinted by permission. 
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Amanda Clement: The Umpire in a Skirt 
Sample Questions — Grade 4 



1. This passage is mostly about how Mandy 

*a. had an unusual career in baseball 

b. convinced her mother to like baseball 

c. put herself through college 

d. wore the first umpire's uniform 

2. What obstacle did Mandy overcome in her 
baseball career? 

a. The players did not respect her. 

b. Baseball was not popular in Iowa, 

*c. Girls did not typically take part in sports, 
d. She did not have very much experience nt baseball. 

3. Write a paragraph explaining how Mandy got hvv 
first chance to be an umpire at a public game, 

4. Which statement is supported by informat ion 
in the passage? 

a. Players never argued with Mandy during a game 1 . 

b. Mrs. Clement liked to watch Mandy piny baHolmlL 
*c. Mnndy was athletic and loved baseball. 

d. Mnndy started the Women's Sports Hall of Fame. 



♦denotes correct answer 
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5. If she were aSive today, what question would you 
like to ask Mandy about her career? Explain why 
the answer to your question would be important 
to know. 



6. Tell two ways in which Ma tidy's experience would 
be similar or different if she were a young girl 
wanting to take part in sports today. 



7. Which event came first in Mandy's career? 

a Mandy was paid to umpire a game. 

b. Mandy was recognized in the Baseball Hall 
of Fame. 

c. Mandy became a teacher and coach. 

*d. Mandy umpired games for her brother and 
his friends. 



8. Give three examples showing that Mandy was 
not a quitter. 



B. The information in the passage is presented 
mainly by 

a. comparing Mandy to other umpires 

*b. discussing important events in Mandy's life 

c describing the game of baseball 

(I providing details about life in the early IflUOs 



10. What was Hank's role in Mandy's curly career? 



Scoring Criteria for Amanda Clement: 
Umpire in a Skirt — Grade 4 



3* Write a paragraph explaining how Mandy got her first 
chance to be an umpire at a public game. 

Acceptable answers indicate that the umpire for a preliminary 
game between two local teams did not show up for the game 
and/or Mandy's brother suggested that she do the job. 

5* If tihe were alive today, what question would you like 
to ask Mandy about her career? Explain why the answer 
to your question would be important to know. 

Unsatisfactory — These responses demonstrate little or no 
understanding by providing isolated bits of information or by 
posing a question that is unrelated to Mandy's experience as a 
woman in a career traditionally dominated by males. In some 
cases, students refer to a line from the text and recast it in the 
form of a question. 

Partial — These responses demonstrate some understanding of 
the information in the article by posing at least one question 
that is either not explained or is explained using circular 
reasoning. 

Essential— These responses demonstrate some understanding 
of the information in the article. They contain at least one 
question that is specifically related to Mandy's career with an 
explanation that is relevant to furthering the student's own 
understanding of how it might feel to be an athlete who is highly 
successful or the first person to do something. 

Extensive — These responses contain one question that is 
explained in relation to the student's personal view of the 
passage and that indicate that the student considered the more 
abstract aspects of the passage. These responses contain ques- 
tions that are about issues or reactions and that grow out of 
careful consideration of the potential problems Mandy faced and 
the historical context in which she lived. 
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6. Tell two ways in which Mandy's experience would be 
similar or different if she were a young girl wanting to 
take part in sports today* 

Acceptable responses mention areas of similarity or differences 
in relating Mandy's experience as an umpire to today's sports 
environment (e.g., less stigma attached to girls pnrticipating in 
sports now; there is more than one umpire at a baseball game 
today). 

8, (Jive three examples showing that Mandy was 
not a quitter. 

Acceptable answers mention three events from the passage that 
reflect positively on Amanda and that demonstrate some deter- 
mination in her character. 

10* What was Hank's role in Mandy's early career? 

Acceptable responses discuss the fact that Hank let Mandy play 
ball and umpire or that he recommended her for the umpire 
position. 



Note: These scoring criteria are a summary of the more exten- 
sive guides used in the NAEP scoring, The full guides include 
examples of student responses for each score point. 
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Grade 8 — Reading to Perform a Task 



Bus Schedule 




.//IS/ 1MN10N 
1M NWN.HMI 
M/l/M/W 



(formerly L Lh§) 

Serving: Trenton 

East Trenton 
Trenton Rail Station 
Labor & Industry Bldg. 
Justice Complex 
Hamilton 
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FLASH A PASS 

NJ TRANSIT offers a variety of bus 
passes. For one discounted monthly 
price you csn travel an unlimited 
number of times within the zone range 
indicated on your pass. Your pass is 
valid on all NJ TRANSIT or NJT 
subsidized reutes (except: 320 * Lincoln 
Tunnel Park A Ride; 321 - Vines 
Lombard! Park a Ride; 32? 
MeadoWlands Psrk A Ride and 302 - NJ 
TRANSIT Newark Airlink) and selected 
private carriers. You'll never need e 
transfer or hsv* to carry exact change 
again. The following passes are 
available, 

e Interstate lus Pass - New Jersey to 
New York 

e Inlfistsle lus Csrd - For travel on 
local lines WITHIN New Jersey 

• Infra-Commuter Pass - Tor commuter 

travel via Routes 9 and 18 to Newark 

or Jersey City 

Aviilibla it outitts throughout tfts Suto or by mail 
dirtct from: HJ TRANSIT - MaM-Nr* -P.O. Nr 110, 
MaptSWM*, MJ. 07140 r#S »•# 1 (MS) 64S-S21S. 
Writs of cill for mora information Snd sn order form 



Ticket Agents 

NJ TRANSIT Mercer Inc. 
1132 E. State SI. 

Trsnton. N.J. 06606 1 (609) 396-91 7 1 
NJ TRANSIT Rsil Ststion 

72 South Clinton Ave 

Trsnton, N.J. 06609 
EDDIES 0ONUTS 

506 Hamilton Ave. 

Trsnton, N.J. 06606 1 (609) 392-4456 

FUJI'S MARKET 
4 N. Broed Si. 

TVtnfon, N.J. 06606 1 (609) 393 1 116 



PteJar tor* 

NJ TRANSIT Rsil Psstengert displaying 
their Monthly Rail Past to sn NJ TRANSIT 
But Driver can gat s Reduced Fsre for s ride 
1o or from s Rail Station 
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To Trenton Rail Station 



Weekdays 

Including tho 
following Holidays 

Lincoln* Birthday 
VMaraiw' Day 



4 

. 1 • 










1 1 • 


AiM( 


A.MV 


AM. 




ATmT 


V. - 


5.66 


6.08 


6.12 


617 


w • 


6.25 


6.38 


6.42 


6.47 


W 6 65 


700 


7.13 


7.17 


7.22 


W - 


7.25 


7.38 


7.42 


7.47 


W - 


7.56 


8.08 


8.12 


8.17 


W 


826 


8.38 


842 


8.47 


W - 


9.25 


9.38 


942 


9.47 


W - 


10.25 


10.38 


10.42 


10.47 


W - 


11,25 


11.38 


11.42 


11.47 


W • 


P.M. 


P.M. 


P.M. 


P.M. 


W • 


12.25 


12.38 


12.42 


12.47 


W • 


1.25 


1.38 


1.42 


1.47 


W - 


225 


238 


2.42 


2.47 


W - 


3.25 


3.38 


3.42 


3.47 


P.M. 










W 3 60 


3.55 


4.08 


4.12 


4.17 


W • 


4.25 


4.38 


4.42 


4.47 


W - 


4.55 


508 


5.12 


5.17 


W • 


5 25 


638 


542 


5.47 


W - 


§55 


999 


612 


9 V 
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NO SERVICE will t» ofwratatj on Sundays 
or (hi following Holidays. New Yaar's Day. 
Memorial Day, Indapandanca Day, Labor 
Day. Thanksgiving Day and Chrislmas Day 
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To East Trenton 



Wttkdays 

Including th« 
following HoJMtyt 

Lincoln't Birthday 
Vft«f»n«' Diy 







** 


I 








i . 


* 


I 

i i 
i i 

/ J 












a a 


n ■ 




<1 






i *" 


► r 




I O 


A.M. 


A.M. 


A.M. 


A.M. 


A.M. 


W 6.25 


6.30 


6.35 


6.48 


653 


W 7.00 


7.05 


7.10 


7.23 




W 7.30 


7.35 


7.40 


7.53 




W 8.00 


8.05 


6.10 


8.23 




W 8.30 


8.35 


8.40 






W 9.00 


9.05 


9.10 


9.23 




W10.00 


10.05 


10.10 


10.23 




W11.00 


11.05 


11.10 


11.23 




P.M. 


P.M. 


P.M. 


P.M. 


PM. 


W 12.00 


12.05 


12.10 


12.23 




W 1.00 


1.05 


1.10 


1.23 




W 2.00 


2.05 


2.10 


2.23 




W 3.00 


3.05 


3.10 


3.23 




W 4.00 


4.05 


4.10 


4.23 




W 4.30 


4.35 


4.40 


4.53 




W 5.00 


5.05 


5.10 


5.23 




W 5.30 


5.35 


5.40 


5.53 




W 6.00 


6.05 


6.10 


6,23 




W 6.30 


6.35 


6.40 


6.53 
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NO SERVICE will be operated on Sundays 
or the following Holidays; New Yeart Day, 
Memorial Day. Independence Day, Labor 
Day, ThankflQivIng Dey and Chrlalmee Day. 



Saturdays 

Including the 
following HolMoya 

UftrUn Luttar King Jr. Day 
^roikftfitt' Dty 
Good Friday 
Columbus Dty 
Election Day 



* Zt 


✓ * 

• A ,; 1 

♦ > ►J 




A.M. 


A.M. 


A.M. 


w 


6.25 


6.38 


6.45 


w 


7.25 


7.38 


7.45 


w 


8.25 


8.38 


8.45 


w 


9.25 


9.38 


9.45 


W 10.25 


10.38 


10.45 


W11.25 


11.38 


11.45 




P.M. 


P.M. 


P.M. 


W12.25 


12.38 


12.45 


W 


1.25 


1.38 


1.45 


W 


2.25 


2.38 


2.45 


w 


3.25 


3.38 


3.45 


w 


4.25 


4.38 


4.45 


w 


5.25 


5.38 


5.45 


w 


6.25 


6.38 


6.45 



iota 



Nolle* to Whttlcholr Pimnjin Cv 

Patttnotri rtqurfrlrig th« um of *httlch«lr lift *r# 
•ncouraytd to Ultphor* 24 hours in idvtrici to 
nollly NJ TRANSIT ol 1h« trip Ihty to ttM 
PImu calf 1 (H00) MM*4# toftmn 1 00 • m and 
10 00 p m Only thftM trips id«nttti«d with • T 
tin tM rMU«KM 
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Saturdays 

Including Iht 
frilowtofl Holidays 

Martin Lutha; King Jr. Day 
Pr aatdanta' Day 

Good FrkJay 
Columbui Day 

Election Day 




Hi 

11 " I 




Notka lo Wht#khilr Pasatngtra 4v 

Pauangcrt raquirkig tha uta o< *r>adcni*r Mft irt 
ancourigad to laiaphona 24 hour* in advanct to 
notify NJ TRANSIT of tha trip thty wish to fika. 
Plttaa call 1 (100) batwaan IPO l m ind 

10 00 pm Only Ihoaa trtpa ttaaifflad *iln a *W 
canbaracutalad. 
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NJ TRANSIT 
Customer Servicee 

If you have a compliment or 
complaint regarding our service or 
employees, please call Customer 
Services Monday thru Friday 8 00 
a m. to 6:00 p.m 

In New Jersey 1 (BOO) 772-3606 
Out of State 1 (201 ) 035-2500 

How to use this schedule 

1 Select day of week desired 

2 Locate direction of travel desired 

3 Locato tlmo check point or 
alternate destination nearest 

you. 

4 Locate time desired under check 
point. 

5 Check meaning of footnotes, IF 
APPLICABLE. 

6. Check but destination sign 
before boarding. 

Transit Information 

(6 a.m. to 12 Midnight Dally) 

Telephone Numbers lor Bus, Train & 
Fare Information 

Northern Ntw Jersey 1 (SOO) 772-2222 
Southern New Jersey 1 (800) 562-5946 
Out of State . 1 (201 ) 460-8444 
•Hearing Impaired 1 (BOO) 772-2287 

' (TTD/TTY - Daily, 6.0Qi.m to Midnight) 

Prohibited on the bus 

1 Smoking of any kind 
2. Eating food and drinking 
beverages 

3 Littering 

4 Loud playing of radios 




Exact Fare Line 

Passengers are required to have 
exact fare In coins no larger than 
a quarter when boarding buses on 
this line. Drivers do not carry money 
and cannot make change 

t(M04S 14M//0 !W 




Bub Schedule 
Sample Questions — Grade 8 



Before answering any of the questions, take a few minutes to 
familiarize yourself with tho bus schedule. 

As you answer the questions about the bus schedule, make notes 
in the margins of the buB schedule about ways that it might be 
improved to make it easier to use. 

1. The schedule is organized from top to bottom 
according to 

*a. time of depart ure 

b. geographic location of the stop 

c. length of the bus ride 

d. alphabetical order of the destination 

2. Explain the most likely reason for scheduling only 
one bus each way between the Good all Rubber 
plant and the railroad station. 

3. What is the meaning of the W in the left margin of 
each line of the schedule? 

a. Weekday service only 

*b. Wheelchair lift 

c. West side of the railroad station 

d. Wednesday service only 

4* On Friday, the ride from the railroad station to 
the intersection of Hanover and Broad takes 10 
minutes. On Buturclay, it takes H minutes. Why do 
the schedules differ? 



denote* correct answer 



6. Luis wants to use the* wheelchair lift. What tele- 
phone number should she call tn arrange this? 

a. 1-201-935-2500 

b. 1-800-772-3606 

c. 1-800-772-2287 
*d. 1-800-582-5946 

6. How long does it take to ride from the intersec- 
tion of Hanover and Broad to the intersection of 
Mulberry and Enterprise? 

a. 5 minutes 

1). 8 minutes 

*c. 13 minutes 

d. 23 minutes 

7. Monthly bus passes are not valid on which routes? 

8. If you need to transfer to connecting bus service 
602, you can make the connection at which of the 
following transfer points? 

a. The Justice Complex 

*b. The intersection of W. State Street and 
Warren Street 

c. The railroad station 

d. The intersection of fttirview Avenue and 
Barlow Street 



Ml 



9. As described in the explanation of how to use the 
schedule, which of the following schedule entries 
is an example of a "check point"? 

a- Presidents 1 Day 

*b. Hanover and Broad 

c. Northern New Jersey 

d. W6.25 

10. Give two reasons why a person might want to 
buy a monthly bus pass. 



11. In which of the following situation! would you 
use this bus schedule? 

a. You live and work in Pennsylvania. 

b. You are traveling to a party in Trenton on Sunday. 

*c. You live in Trenton and work at the Justice 
Complex. 

d. You want information about railroad schedules to 
New York City. 



12. Now that you have looked carefully at the 
bus schedule, use your notes and make sugges- 
tions to help New Jersey Transit improve this 
schedule. 




Scoring Criteria for Bus Schedule — Grade 8 



2. Explain the mart likely reason for scheduling only one 
bus each way between the Goodall Rubber plant and the 
railroad station. 

Acceptable answers indicate that students recognize the Goodall 
Rubber plant Is a work stop and that the buB provides workers 
wit h transportation to their jobs. 

4. On Friday, the ride from the railroad station to the 
intersection of Hanover and Broad takes 10 minutes. On 
Saturday, it takes 8 minutes* Why do the schedules differ? 

Acceptable responses suggest a plausible reason that is based on 
accurate information from the bus schedule. 

7. Monthly bus passes are not valid on which routes? 

Acceptable answers indicate all four of the routes identified in 
the bus schedule as not valid with monthly passes. 

10. Give two reasons why a person might want to buy a 
monthly pass. 

Acceptable responses provide two reasons as indicated in the 
bus schedule (e.g., to avoid needing transfers or exact change, or 
to permit unlimited travel in the zone range). 



r r 
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I'J, Now Hint you have looked carefully at the hue sched- 
ule, um« vnyy notes and make suggestions to help New 
Jersey Transit Improve this schedule. 

Unsatisfactory— These responses demonstrate little or no 
ability to critically evaluate the bus schedule. They contain 
suggestions that are circular, inappropriate, or merely expres- 
sions of a personal opinion about the quality of the schedule. 

Partial — These responses demonstrate some ability to critically 
evaluate the bus schedule by making one suggestion that clearly 
would improve the bus schedule. Some of these responses 
describe a problem with the schedule in which a suggestion for 
improving it was implied. 

Essential — These responses provide at least two suggestions for 
the bus schedule that would clearly be improvements. The 
suggestions provided in these responses tend to be very specific 
and relate to certain parts of the schedule. 

Extensive— These responses provide at least three suggestions 
for the bus schedule that would clearly be improvements. At 
least one of these suggestions demonstrates a connection across 
parts of the schedule and represents a more global consideration 
of the schedule than Essential level responses display. 



Note: These scoring criteria are a summary of the more exten- 
sive guides used in the NAEP scoring. The full guides include 
examples of student responses for each *core point. 
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Grade 12 — Reading for Literary Experience 



The death of the hired man 

by Robert Frost 

Mary sat musing on the lamp-flume at the table 

Waiting for Warren. When she heard his step, 

She ran on tip-toe down the darkened passage 

To meet him in the doorway with the news 

And put him on his guard. "Silas is back." 

She pushed him outward with her through the door 

And shut it after her. "Be kind," she said. 

She took the market things from Warren's arms 

And set them on the porch, then drew him down 

To sit beside her on the wooden steps. 

"When was 1 ever anything but kind to him? 

But I'll not have the fellow back," he said. 

"I told him so last haying, didn't I? 

'If he left then,' I said, 'that ended it.' 

What good is he? Who else will harbor him 

At his age for the little he can do? 

What help he is there's no depending on. 

Off he goes always when I need him most. 

'He thinks he ought to earn a little pay, 

Enough at least to buy tobacco with, 

So he won't have to beg and be beholden.' 

'All right,' I say, 4 I can't afford to puy 

Any fixed wages, though I wish I could.' 

'Someone else can.' 'Then someone else will have to.' 

1 shouldn't mind his bettering himself 

If that was what it was. You can be certain, 

When he begins like that, there's someone at him 

Trying to coax him off with pocket-money — 

In haying time, when any help is scarce. 

In winter he comes back to us. I'm done." 
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"Sh! not so loud: he'll hear you," Mary said. 

"I want him to: he'll have to soon or late." 

"He's worn out. He's asleep beside the stove. 
When I came up from Rowe's I found him here, 
Huddled against the barn-door fast asleep, 
A mi^rable sight, and frightening, too — 
You needn't smile — 1 didn't recognize him — 
1 wasn't looking for him — and he's changed. 
Wait till you see." 

"Where did you say he'd been?" 

"He didn't say. 1 dragged him to the house, 
And gave him tea and tried to make him smoke. 
I tried to make him talk about his travels. 
Nothing would do: he just kept nodding off." 

"What did he say? Did he say anything?" 

"But little." 

"Anything? Mary, confess 
He said he'd come to ditch the meadow for me." 

"Warren!" 

"But did he? I just want to know." 

"Of course he did. What would you have him say? 

Surely you wouldn't grudge the poor old man 

Some humble way to save his self-respect. 

He added, if you really care to know, 

He meant to clear the upper pasture, too. 

That sounds like something you have heard before? 

Warren, I wish you could have heard the way 

He jumbled everything, I stopped to look 

Two or three times — he made me feel so queer 

To see if he was talking in his sleep. 

^ 'J 



He ran on Harold Wilson — you remember — 
The boy you had in haying four years since. 
He's finished school, and teaching in his college. 
Silas declares you'll have to get him back. 
He says they two will make a team for work: 
Between them they will lay this farm as smooth! 
The way he mixed that in with other things. 
He thinks young Wilson a likely lad, though daft 
On education — you know how they fought 
All through July under the blazing sun, 
Silas up on the cart to build the load, 
Harold along beside to pitch it on." 

"Yes, I took care to keep well out of earshot." 

"Well, those days trouble Silas like a dream. 

You wouldn't think they would. How some things linger! 

Harold's young college boy's assurance piqued him. 

After so many years he still keeps finding 

Good arguments he sees he might have used. 

I sympathize. I know just how it feels 

To think of the right thing to say too late. 

Harold's associated in his mind with Latin. 

He asked me what 1 thought of Harold's saying 

He studied Latin like the violin 

Because he liked it — that an argument! 

He said he couldn't make the boy believe 

He could find water with a hazel prong — 

Which showed how much good school had ever done him. 

He wanted to go over that. But most of all 

He thinks if he could have another chance 

To teach him how to build a load of hay — " 

"I know, that's Silas' one accomplishment. 
He bundles every forkful in its place, 
And tags and numbers it for future reference, 
So he can find and easily dislodge it 




In the unloading. Silusdoes that well. 
He takes it out in bunches like big birds' nests. 
You never see him standing on the hay 
He's trying to lift, straining to lift himself." 

"He thinks if he could teach him that, he'd be 
Some good perhaps to someone in the world. 
He hates to see a boy the fool of books. 
Poor Silas, so concerned for other folk, 
And nothing to look backward to with pride, 
And nothing to look forwurd to with hope, 
So now and never any different." 

Part of a moon was falling down the west, 
Dragging the whole sky with it to the hills. 
Its light poured softly in her lap. She saw 
And spread her upron to it. She put out her hand 
Among the harp-like morning-glory strings, 
Taut with the dew from garden bed to eaves, 
As if she played unheard the tenderness 
That wrought on him beside her in the night. 
"Warren," she said, "he has come home to die: 
You needn't be afraid he'll leave you this time." 

"Home," he mocked gently. 

"Yes, what else but home? 
It all depends on what you mean by home. 
Of course he's nothing to us, any more 
Than was the hound that came a stranger to us 
Out of the woods, worn out upon the trail." 

"Home is the place where, when you have to go there, 
They have to take you in." 

"1 should have called it 
Something you somehow haven't to deserve." 
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Warren leaned out and took a step or two, 
Picked up a little stick, and brought it back 
And broke it in his hand and tossed it by. 
"Silas has better claim on us, you think, 
Than on his brother? Thirteen little miles 
As the road winds would bring him to his door. 
Silas has walked that far no doubt today. 
Why didn't he go there? His brother's rich, 
A somebody — director in the bank." 

"He never told us that." 

"We know it though.' 

"I think his brother ought to help, of course. 

I'll see to that if there is need. He ought of right 

To take him in, and might be willing to — 

He may be better than appearances. 

But have some pity on Silas. Do you think 

if he'd had any pride in claiming kin 

Or anything he looked for from his brother, 

He'd keep so still about him all this time'.'" 

"I wonder what's between them." 

"I can tell you 

Silas is what he is — we wouldn't mind him — 

But just the kind that kinsfolk can't abide. 

He never did a thing so very bad. 

He don't know why he isn't quite as good 

As anyone. He won't be made ashamed 

To please his brother, worthless though he is." 

"I can't think Si ever hurt anyone." 

"No, but he hurt my heart the way he lay 

And rolled his old head on that sharp-edged chair-back. 

He wouldn't let me put him on the lounge. 

You must go in and see what you can do. 



I made the bed up for him there tonight. 

You'll be surprised at him — how much he's broken. 

His working days are done; I'm sure of it." 

"I'd not be in a hurry to say that." 

"I haven't been. Go, look, see for yourself. 
But, Warren, please remember how it is: 
He's come to help you ditch the meadow. 
He has a plan. You mustn't laugh at him. 
He may not speak of it, and then he may. 
I'll sit and see if that small sailing cloud 
Will hit or miss the moon." 

It hit the moon. 
Then there were three there, making a dim row, 
The moon, the little silver cloud, and she. 

Warren returned — too soon, it seemed to her, 
Slipped to her side, caught up her hand and waited. 

"Warren," she questioned. 

"Dead," was all he answered. 



From The Poetry of Robert Frost edited by Edward Connery 
Lathem. Copyright 1928, © 1969 by Holt, Rinehort and 
Winston. Copyright © 1956 by Robert Frost. Reprinted by 
permission of Henry Holt and Company, Inc. 
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The death of the hired man 
Sample Questions — Grade 12 



1. Mary does not criticize Silas 9 offer to help on the farm 
the way Warren does because x 

*a. she knows Silas is only attempting to save his 
self-respect 

b. she believes that Warren really needs his help 
with haying 

c, she wants Silas to please his brother 

4. she does not want Silas to think she is rude 

2. What are two types of relationships that Robert Frost 
explores in the poem? 

3. Mary meets Warren at the door and tells him that 
Silas is back so that 

a. they can go to the market for some tobacco 

b. Warren can count on Silas* help to ditch the meadow 

c. they can call Silas* brother to pick up Silas 
*d. Warren will be careful about what he said 

4. Warren defined "home" as "the place where, when you 
have to go there, They have to take you in." Explain 
why you agree or disagree with Warren. 

5. Why does Mary listen to Warren complain about Silas? 

6. What is really bothering Warren about Silas 9 return? 

a. He does not have the money to pay Silas' salary, 

b. He does not like to get in arguments with Silas. 
*c. He believes Silas will leave again. 

d. Silas does not work hard enough to suit him. 



♦denotes correct answer 



7. What kind of relationship did Silas have with 
his brother? 

H. How did Silas view formal education? 

a. He said it was necessary in order to be self-assured, 
h. He valued it as a way to learn farming. 
1 c. He thought it was impractical and a waste of time, 
d. He felt it caused people to argue too much, 

9. From your experience, do you think that most people 
would do what Mary did for Silas? Explain why or 
why not. 

10. How does Robert Frost use the relationship between 
Mary and Warren to help explain the character of 
Mary? Support your answer with evidence from 
the poem* 

11. What does Warren mean when he says, "I'm done"? 

12. What does Mary mean when she says that home is 
"Something you somehow haven't to deserve"? 

a. You have In work hard to he part of a family. 
I). Il is a plan* where people merely tolerate you. 
iv You do not have to he related to someone 

In he accepted. 
' d. Il in something you do not have 1 to earn. 
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Scoring Criteria for The death of 
the hired man 



2. What are two type* of relationships that Robert Frost 
explores in the poem? 

Acceptable responses mention any two relationships that are 
described explicitly or implicitly in the poem (e.g., husband and 
wife, worker and boss, young and old, etc.) 

4. Warreu defined "home" as "the place where, when you 
have to go there, They have to take you in." Explain why 
you agree or disagree with Warren, 

Acceptable answers provide an opinion and an explanation of 
why that opinion is held; or an explanation from which an 
opinion can be readily inferred. The explanation must be non- 
circular and reflect an understanding of Warren's statement. 

5. Why does Mary listen to Warren complain about Silas? 

Acceptable responses provide an answer which refers to Mary's 
character and indicate her motivation to help Silas, or her 
respect for Warren. 

7. What kind of relationship did Silas have with his 
brother? 

Acceptable responses appropriately describe the relationship as 
being distant, broken, or some other description that reflects 
understanding of the lack of a close or supportive relationship 
between the two brothers. 

9. From your experience, do you think that most people 
would do what Mary did for Silas? Explain why or why 
not. 

Acceptable answers provide an opinion that was supported by 
something from the student's experience. The answer also had to 
correctly state or imply that Mary tried to understand Silas' 
behavior or to see things from his perspective* 




10. How does Robert Frost use the relationship between 
Mary and Warren to help explain the character of Mary? 
Support your answer with evidence from the poem. 

Unsatisfactory— These responses provide inappropriate or 
inaccurate information about Mary's character and/or the 
relationship. They demonstrate little or no understanding of 
Warren and Mary's relationship within the poem and no ability 
to objectively consider the poet's use of the relationship in the 
poem. 

Partial— Th ese responses demonstrate some understanding of 
the character of Mary or the relationship between Mary and 
Warren. However, they are unable to provide evidence from the 
poem to establish a connection between the relationship and the 
poet's portrayal of Mary's character. 

Essential — These responses demonstrate understanding of both 
Mary's character and the relationship between Warren and 
Mary. In addition, they are able to make some connection 
between this relationship and the poet's portrayal of Mary's 
character by using evidence from the poem. This connection, 
however, is usually limited to describing how Mary's character is 
exposed during the interactions between Warren and Mary. 

Extensive — These responses move beyond simply describing 
Mary's character within the relationship to focusing on how the 
poet intentionally used their relationship in several parts of the 
poem to portray Mary in a particular light. Responses at this 
level demonstrate a clear critical stance by being explicit about 
their consideration of the poet's techniques and purposes as well 
as providing appropriate evidence from the poem. 

11. What does Warren mean when he says, "I'm done"? 

Acceptable answers indicate that Warren meant that he was 
finishing helping or tolerating Silas; or that he was not going to 
let Silas return to the farm. 



Note: Those scoring criteria are a summary of the more exten- 
sive guides used in the NAEP scoring. The full guides include 
examples of student responses for each score point. 




